Attorney Docket No. : 1 00 1 -01 8 6 

"Express Mail" mailing label number: 

ELhfl 4EEhE MSUS 



VARIABLE MAXIMUM DIE TEMPERATURE BASED ON PERFORMANCE 

STATE 

Frank P. Helms 
Jeffrey A. Brmkley 

BACKGROUND 
Field of the Invention 

[1001] This invention relates to computer systems and more particularly to power 
management of computer systems. 

Description of the Related Art 

[1002] An important market criteria for microprocessors is the rated frequency at 
which the microprocessor operates, typically denominated in hundreds of MHz or 
GHz. Rated frequency is used as a surrogate for performance and higher performance 
processors command higher prices. Thus, it is advantageous to market processors 
with the highest possible frequency rating. 

[1003] However, there are limitations as to how high one may rate a processor in 
terms of frequency. As the number of transistors provided on a single integrated 
circuit has increased and the clock speed of integrated circuits has increased, power 
and related thermal considerations have become an important consideration in 
computer design. Power and thermal considerations can limit processor performance 
in certain environments, particularly in mobile applications. Computer systems 
measure the die temperature or case temperature using sensors on or close to the 
processor. In order to keep processor die temperatures within safe bounds to avoid 
potential damage to the processor, passive and active cooling have traditionally been 
employed to control temperature. Passive cooling has been accomplished by reducing 
a processors clocks speed, either by throttling processor clocks (reducing effective 
frequency by turning clocks off for a predetermined period) or by reducing actual 
frequency of the clocks. Reducing the actual and/or effective frequency of an 

- 1 - 

Final Patent Application 1001-0186.doc 
Client Reference: TT4882 



Attorney Docket No.: 1001-0186 



integrated circuit causes a reduction in power consumption and thus reduces 
temperature. In addition to reducing clock frequency, it is known in the art to reduce 
voltage in conjunction with reduced clock speed to achieve additional cooling. 

[1004] Thus, the rated processor speed can be limited by power and thermal 
considerations and more specifically is determined, at least in significant part, by 
operating frequency, voltage, and temperature. If the die temperature can be kept 
sufficiently low, the rated processor clock speed can be increased. In one prior art 
approach to maximizing frequency at which a processor can be marketed, the 
processor includes an on-die temperature sensor that automatically throttles (reduces) 
the CPU's clock by 50% if the processor's temperature crosses a factory set threshold. 
If the maximum die temperature is set at a sufficiently low level of, e.g., 70 degrees 
C, the processor is able to meet the timing budget for the silicon process in which it is 
manufactured at a higher frequency at a given voltage than if the die temperature was 
significantly higher. The timing budget is the amount of time a signal has to 
propagate through combinational logic from one set of storage elements (e.g., flip- 
flops) to another set of storage elements and meet the setup and hold times associated 
with the flip-flops. At a lower temperature, a device can more easily meet a timing 
budget because, e.g., the propagation delays are reduced. Thus, to ensure that timing 
budgets are met, in the prior art approach described above, when the maximum die 
temperature associated with the device is crossed, e.g., 70 degrees C, the processor 
clock is throttled back to, e.g., 50% of its rated speed, which reduces the power 
consumption and thus the temperature. Thus, a processor rated at 2 GHz would run at 
1 GHz upon crossing of the maximum die temperature threshold. In that way the 
processor can be rated at a higher speed at or below 70 degrees C, although it may 
operate with significantly reduced capability above that temperature. 

[1005] While that allows the processor to be rated highly, it also results in a 
system that operates at a significantly lower clock speed in certain environments. It 
would be desirable to ship more higher speed rated processors without having to 
drastically sacrifice performance when the critical temperature threshold is crossed. 
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SUMMARY 

[1006] Accordingly, the invention provides a system in which the maximum 
performance state, which is typically based on such factors as operating frequency 
and voltage, changes according to thermal criteria. The thermal criteria may be, for 
example, a die temperature of the microprocessor. Once the temperature crosses 
above a predetermined temperature threshold, the maximum performance state 
available to the system is changed to a lower performance state. As the temperature 
crossed above successive temperature thresholds, successively lower maximum 
performance states become available to the system. That allows processor 
performance to be impacted less than the throttling alternative described above as the 
temperature increases. When the temperature crosses below a predetermined 
temperature threshold, a higher maximum performance state is again available to the 
system. Hysteresis may be implemented to ensure the system does not rapidly switch 
between performance states when the temperature is close to predetermined 
thresholds. 

[1007] In an embodiment, the invention provides a processor that has multiple 
performance states determined by such factors as operating frequency and/ or voltage. 
In a first temperature range, the processor operates with a first maximum performance 
state and in a second temperature range, higher than the first temperature range, the 
processor operates with a lower maximum performance state. 

[1008] In another embodiment the invention provides a method of operating a 
computing system that includes determining a temperature associated with an 
integrated circuit and operating the integrated circuit with a first performance state as 
a maximum performance state according to the determined temperature, the first 
performance state being one of a plurality of performance states available at the 
determined temperature. 

[1009] In another embodiment a method for providing a variable maximum die 
temperature for an integrated circuit in a computer system having a plurality of 
different maximum performance states, comprising increasing the maximum 
allowable die temperature as a maximum allowable performance state is decreased. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[1010] The present invention may be better understood, and its numerous objects, 
features, and advantages made apparent to those skilled in the art by referencing the 
accompanying drawings in which the use of the same reference symbols in different 
drawings indicates similar or identical items. 

[1011] Fig. 1 is a high level flow diagram of power management operations based 
on CPU utilization. 

[1012] Fig. 2 illustrates switching between performance states according to 
utilization. 

[1013] Fig. 3 illustrates an exemplary processing system that can change 
performance state. 

[1014] Fig. 4 illustrates a table including various temperature trip points for an 
exemplary system. 

[1015] Fig. 5 shows the high level flow of an embodiment of the invention in 
which the maximum performance state available is adjusted according to temperature 
measurements. 

DESCRIPTION OF THE PREFERRED EMBODIMENT(S) 

[1016] A computer system according to one embodiment of the invention has a 
plurality of processor performance states, the processor performance states being 
generally determined by unique voltage/frequency combinations. The computing 
system provides lower maximum performance states as the detected temperature of 
,e.g. the processor die, increases. In addition to having a different maximum 
performance state associated with particular temperature ranges, the computer system 
may change to a different performance states based on such factors as processor 
utilization as explained more fully herein. The detected temperatures may be related 
directly to the processor by measuring the die temperature directly using a sensor on 
the die or may measure the die temperature indirectly using a sensor that is off-die. In 
addition, other indirect measurements may be taken such as ambient temperatures or 
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measurements of the temperature of other computer system components to determine 
the appropriate mode of operation although indirect measurements may reduce 
accuracy. Because the different temperature ranges have different maximum 
performance states, the maximum amount of power that can be consumed grows less 
as the temperature increases through the various temperature ranges and lower 
maximum performance states are provided. 

[1 017] While a performance state is commonly based in operating voltage and 
frequency, other criteria can also be used. For example, in some embodiments, 
processor performance states could be determined by an amount of chip area that was 
enabled for processing. Thus, portions of the processor may be selectively disabled to 
control the amount of power consumed. For example, the number of execution units 
that are enabled may vary. 

[1018] In order to more fully appreciate the invention, the use of performance 
states is described in which a power management control function in the computer 
system periodically determines the utilization level of the processor, i.e., how much of 
the available processor resources are being utilized, and selects a performance state 
that is appropriate for the utilization level. Referring to Fig. 1, a flow diagram 
illustrates at a high level, operation of an embodiment of a power management 
function utilized to provide the requisite power management control. The current 
CPU utilization is periodically determined in 101 . That current utilization is then 
compared to a high threshold level, e.g., 80% of processing resources, in 103. If the 
utilization level is above the high threshold level, indicating that processor resources 
are being utilized at a level above 80%, the power management control function 
increases the performance state of the processor in 105. In one embodiment, that can 
be accomplished by selecting a voltage/frequency pair that provides greater 
performance and then causing the processor to operate at the new voltage and 
frequency, as described further herein. 

[1019] If the current utilization is below the high threshold, then the current 
utilization is compared to the low threshold in 107. An exemplary low threshold level 
is 55%. If the current utilization is below that low threshold, the power management 
control function decreases the performance state of the processor in 109. As 
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described further herein, that may be accomplished by selecting, e.g., a 
voltage/frequency pair providing lower performance and then causing the 
performance change to occur. The power management control function then returns 
to 101 to periodically determine the utilization level and again compare the current 
utilization level to the high and low threshold levels. In that way the power 
management can tailor the performance state of the processor to the actual 
requirements. 

[1020] hi a computer system with several possible processing performance states, 
if the management control function determines that more performance is necessary to 
meet performance requirements, one approach to providing increased performance is 
to increase the performance one step at a time until the current utilization is below the 
high threshold level. However, in another approach rather than increasing the 
performance state one step at a time, the power management control function selects 
the highest performance state regardless of the current performance state. The 
reasons for always selecting the highest possible performance state when a higher 
performance state is needed are as follows. In computer systems, performance 
demands are often of a bursty nature. When a higher performance state is required 
based on the current utilization level, stepping the performance state to a next higher 
level can result in degradation of performance that can be perceived by the user. That 
is especially true when the task that needs the increased performance requires a near 
real-time response, for instance, while decoding an audio or video file. 

[1021] Fig. 2 illustrates that concept. Assume the processor has five performance 
states P0-P4, with P0 being the highest and P4 the lowest. Whenever the power 
management determines that a higher performance state is required when operating at 
any of the levels P1-P4, the power management selects the maximum performance 
state P0 as the next performance state. Thus, in one embodiment, if the performance 
state is always taken straight to the maximum performance state when a performance 
increase is required, rather than stepping up to the maximum performance state, there 
is less of a chance that a user could notice any performance degradation. In effect, the 
power management control function anticipates a peak loading by assuming that any 
indication of a required increase in performance is assumed to be a burst requiring 
peak performance. 
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[1 022] However, if a lower performance state is required, a next lower 
performance state is selected. Thus, if at performance state P0, PI is selected as the 
next lower performance state. If the current performance state is PI, the next lower 
performance state selected is P2 when a performance decrease is effectuated by the 
power management control function. In that way, if the performance is still too high, 
successively lower performance states can be selected and the chance than any 
degradation is detected by a system user is reduced. Thus, if the utilization 
information indicates that an increase in performance is necessary, the power 
management control function selects the maximum (or near maximum) performance 
state, while a decrease in performance causes the power management control function 
to step to the next lowest performance state. 

[1023] If the processor utilization is kept within the range of the high and low 
thresholds, then a user should experience a crisp, high performance system, while still 
getting the benefit of power savings for those applications or those portions of 
applications requiring less performance. That approach reduces power consumption, 
extends battery life, reduces temperature resulting in less need for cooling and thus 
less fan noise, while still maintaining high performance and thus maintaining a 
perception of fast response to the user. Note that running at a lower average CPU die 
temperature increases CPU reliability, and that a lower CPU temperature results in a 
lower system temperature, which increases system reliability. 

[1024] In order to effect changes to the performance state, the power management 
software has to cause the voltage and frequency used by the CPU to change. In one 
embodiment that can be accomplished as follows. Referring to Fig. 3, a processor is 
shown that can dynamically adjust its frequency and/or operating voltage to provide 
better thermal and power management in accordance with processor utilization. 
Processor 301 includes a programmable voltage control field 303, core clock 
frequency control field 304 and count field 305. Those fields may be located in one 
or more programmable registers. When the processor and/or system determines that a 
change to the operating voltage and/or frequency is desired to increase or decrease the 
performance state, the desired frequency and voltage control information are loaded 
into frequency control field 304 and voltage control field 303, respectively. Access to 
a register containing those fields, or an access to another register location, or access to 

-7- 

Final Patent Application 1 00 1 -0 1 8 6 .doc 
Client Reference: TT48S2 



Attorney Docket No. : 1 00 1 -0 1 86 



a particular field in one of those registers can be used as a trigger to initiate the 
protocol for a performance state change. The protocol, which will vary according to 
processor design, ensures that the processor enters a quiescent state that is suitable for 
performance state transitions. 

[1 025] In some protocols, that will ensure that the portion of the processor, 
referred to for convenience herein as the CPU core logic 3 1 1 becomes quiescent, 
including any external bus interfaces 310 and interfaces with internal logic that may 
not be affected by the performance state change. Note that in one implementation bus 
interface 310 is implemented separately from CPU core logic 311 and functions to 
hold off traffic to CPU core logic 311 during performance state transitions. Various 
messages may be sent or signals provided indicating that the processor has or is about 
to enter the quiescent state. In addition various control and/or status signals 309 and 
3 1 3 may be provided to and from core logic 311. Note that in some processor 
implementations, various power planes and clock grids may ensure some parts of the 
processor are unaffected by the processor core logic 311 entering the quiescent state. 
Further, the quiescent state may vary according to processor design. For example, for 
one processor the quiescent state may have the clocks turned off and in other 
processors, the clocks may be reduced to an extent to allow appropriate voltage 
changes. Note also that the power state changes may include clock frequency 
changes, voltage changes or both. In x86 architectures, such a quiescent state has 
been referred to as the "stop grant" state in which execution of operating system and 
application code is stopped. As would be known to those of skill in the art, other 
ways may be used to initiate the protocol necessary to enter the quiescent state 
suitable for performance state changes. For example, initiation of the protocol to 
enter the quiescent state may be indicated by writing a command over a 
communication link coupling the processor to another device. 

[1026] Once in the quiescent state, the processor can transition the voltage and 
frequency to the new states specified in voltage control field 303 and clock frequency 
control field 304. As described above, in some processor implementations, the 
processor core clocks are stopped after the processor enters the quiescent state to 
suitable for changing performance states. In other processor implementations, the 
processor core clock frequency is reduced to a frequency which can safely tolerate 
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desired voltage changes. In one implementation clock control frequency information 
is supplied as multiplier values for a clock that is supplied to processor 301 . Those of 
skill in the art appreciate that many other approaches can be used to specify the core 
operating frequency. In either case, the voltage control information specified in 
voltage control field 303 is supplied to voltage regulator 315 which in turn supplies 
CPU core logic 311 with the new voltage during the quiescent state. As will be 
appreciated by those of skill in the art, there are many alternatives to supplying the 
voltage information to an external voltage regulator from a register in the processor. 
For example, the voltage information may be supplied from a device outside the 
processor, or may be supplied by a communication link with a voltage regulator 
circuit. 

[1027] Because changing the voltage and frequency can not be done 
instantaneously, the quiescent state is typically maintained for a period of time to 
allow the new voltage and clock frequency to stabilize. That time period may be 
specified in count field 305 and counted using a counter in the processor or in another 
location in the computer system. Once the count is complete, the protocol is initiated 
to exit the quiescent state and resume executing operating system and application 
code, including restarting any buses that have been "turned off by the processor as 
part of entering the quiescent state. 

[1028] Note that changing both voltage and frequency to enter a new performance 
state can be particularly effective. Changes in the processor's core clock frequency 
have an approximately linear affect on the power dissipated by the processor. Thus, a 
20% reduction in clock frequency reduces the power dissipated by the processor by 
20%. The range of change is significant since a ratio of highest frequency to lowest 
frequency is usually greater than 2:1 . Consequently, the processor's power may be 
changed by similar ratio. Changes in the processor's core voltage have an 
approximately square law effect. That is, potential power savings is proportional to 
the square of the voltage reduction. The square law effect results in significant 
changes in the processor's power if the core voltage of the processor is reduced. 

[1029] In addition to modifying processor frequency and/or voltage and to match 
processor utilization, computer systems also monitor temperature and take active or 
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passive power management actions to ensure that the temperature of the processor die 
stays within operational levels using power management control software such as that 
associated with the Advanced Configuration and Power Interface (ACPI) 
Specification. For example, at certain temperatures, the computing system may take 
actions that take active power management action such as turning on a fan, or 
increasing fan speed. At other temperatures, a computer system may take passive 
actions such as throttling the processor (reducing its effective frequency by stopping 
or slowing clocks with a predetermined duty cycle and period appropriate for the 
processor). At another temperature threshold, the processor may shut down the 
computer system to prevent potential damage. Fig. 4 illustrates an exemplary set of 
temperature "trip points" at which power management activities take place. As 
shown in Fig. 4, there are "active" trip points at which various actions are performed 
such as adjusting fan speed. The types of actions described in Fig. 4 are in addition to 
the utilization based power management described previously. The actual 
temperatures, the number of trip points, and the specific actions taken will of course 
vary according to the particulars of the computer system. 

[1030] Note that the power management control described herein may be 
implemented as part of the operating system (OS), in whole or in part. In addition, 
separate power management applications may incorporate some or all of the 
capability described herein. In other computer systems, the various power 
management tasks may be shared between the operating system, software applications 
running under the operating system and BIOS routines. In addition, the power 
management techniques may be implemented in hardware. 

[1031] Now that the process of changing processor states has been described, and 
the utilization of trip points in power management has been described, the utilization 
of different maximum performance states based on temperature will be described. 
Assume that a processor system has five performance states P0- P4, with P0 being the 
highest performance state. The highest performance state is that state having the 
highest clock frequency (and in some embodiments the highest voltage) and having 
the highest power consumption. Referring again to Fig. 4, the performance states 
available are shown to be based on temperature range. 
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[1 032] In the example shown in the last column of the table in Fig. 4, when the 
die temperature is below 70C, all the performance states are available (P0 - P4) and 
the maximum performance state available, e.g., for utilization based (or other) power 
management activities, is the maximum performance state that the system provides, 
namely P0. When the temperature is between 70C and 80C, the performance states 
available are P1-P4 with the maximum available performance state being PI. Finally, 
when the temperature crosses above 80C the available performance states are further 
reduced, with the maximum available performance state being P2. Thus, the 
embodiment represented in Fig. 4, both the number of performance states and the 
maximum performance state changes based on temperature trip points of 70C and 
80C. 

[1033] When the temperature falls back into a temperature range, e.g., < 70C, the 
higher maximum performance state once again becomes available. However, in one 
embodiment a temperature trip point that causes the system to make a higher 
maximum performance state available differs from the temperature trip point that 
causes a lower maximum performance state to be available. That provides hysteresis 
and avoids frequent changes in the available maximum performance state if the 
temperature is at or near a trip point. 

[1034] In the example shown in Fig. 4, hysteresis is implemented by causing P0 
to become unavailable as the maximum performance state at 70C but to again become 
available at a temperature trip point of 68C. Thus, if the system is operating with PI 
as the maximum performance state and a temperature of 68C is detected, P0 becomes 
the maximum performance state. Similarly, PI becomes unavailable as the maximum 
performance state at 80C but again become available as the maximum performance 
state when the temperature crosses back below 78C. Note that in various 
implementations, the system may detect whether the temperature is greater than, 
greater than or equal to, equal to, less than or less than or equal to a particular 
temperature, as appropriate for the particular situation, to determine if the system has 
crossed a temperature trip point. 

[1035] Note that the available performance states may be implemented as a table 
or other data structure in BIOS, in application software, or in a power management 
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portion of the operating system software. Other ways to encode the appropriate 
performance states according to the temperature would be readily apparent to those of 
skill in the art. 

[1036] The flow chart in Fig. 5 provides a high level illustration of the operation 
of an embodiment of the invention. For ease of understanding, Fig. 5 deals with 
maximum performance state transitions and does not illustrate operations of all power 
management functions. The flow chart corresponds to an embodiment of the 
invention that utilizes three temperature ranges illustrated in Fig. 4. In 500, a 
temperature associated with the microprocessor, e.g., a die temperature of the 
microprocessor, is supplied or obtained. The system checks to see if it is operating 
with the maximum performance state being P0 in 503. If so, the system checks to see 
if the temperature has crossed above the 70C trip point. If so, at 507, the system 
changes the maximum available performance state to PI and returns to obtain another 
temperature reading. If the maximum available performance state is not P0, then the 
system checks to see at 509 if the maximum performance state is PI. If so, system 
checks to see if the temperature has crossed below 68C in 51 1. If so, the maximum 
performance state is changed to P0 in 513. If not, the system checks in 515 if the 
temperature has crossed above the 80C trip point. If so, the maximum performance 
state is reduced to P2 in 517. 

[1037] If the maximum performance state was determined in 509 to not be PI, 
then the system determines that the maximum performance state is P2 and the system 
checks to see if the temperature is less than or equal to the 78C trip point in 521 . If 
so, the maximum performance state is increased to PI in 523 and the system returns to 
500 to obtain a current temperature. 

[1038] Note that the embodiment illustrated in Fig. 5 provides for increasing or 
decreasing the maximum performance state by one performance state. In other 
embodiments, the system software and/or hardware may allow for maximum 
performance state changes of more than one performance state. In addition, while 
only two trip points are illustrated for reducing a maximum performance state and 
only two trip points are illustrated for increasing the maximum performance state, the 
number of trip points can of course vary depending on system design. 
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[1 039] In the embodiment illustrated in Fig. 5, hysteresis is implemented at 5 1 1 
and 521 such that the temperature at which the system switches back to a higher 
maximum performance state is different (and lower) than the temperature at which it 
switched away from that maximum performance state to a lower maximum 
performance state. While implementation of hysteresis is not necessary to practice 
the invention, it does prevent frequent switching between maximum allowable 
performance states when the temperature is hovering around a trip point. 

[1040] If no trip points are crossed, then the maximum performance state remains 
the same. The process continues periodically evaluating temperatures and setting the 
appropriate maximum performance state based on the evaluated temperature. In that 
way, the maximum performance state is determined based on thermal criteria. The 
system is free to switch to lower performance states according to power management 
considerations such as processor utilization. 

[1041] While Fig. 5 provides a high level description of the operation of an 
embodiment of the invention, determining when temperature thresholds have been 
crossed may be interrupt driven. For example, temperature sensor apparatus may 
include programmable high and low thresholds, and generate an interrupt when one of 
the thresholds is crossed. If the threshold that is crossed causes a maximum 
performance state change, the high and low thresholds may be set to new threshold 
values appropriate for the new maximum performance state. The control software is 
then invoked to change maximum performance states on occurrence of another 
interrupt. 

[1042] In comparison to prior art approaches, changing the maximum available 
performance state according to temperature provides for more gradual reduction in 
performance as temperature increases. That more gradual reduction in performance 
results in higher average system performance as temperature increases in comparison 
to the prior art approach of throttling the clock by a fixed percentage, e.g., 50%, as 
soon as a first temperature trip point is reached. Thus, a more gradual reduction in 
performance is provided while still maintaining a high speed rating of the processor in 
more ideal conditions. 



Final Patent Application 1001-0186.doc 
Client Reference: TT4882 



- 13 - 



Attorney Docket No. : 1 00 1 -0 1 86 



[1 043] In addition, decreasing the maximum allowable performance state as the 
temperature goes higher as described herein, allows the case temperature to go higher 
than solutions that utilize throttling that try to maintain the case temperature at or 
below a fixed temperature. Allowing the temperature to go higher and not being 
limited to a fixed case temperature may reduce thermal design costs since the higher 
allowable case temperature can simplify the thermal design by allowing the system to 
remove less heat from the system. 

[1044] As described herein, a computer dynamically adapts its maximum 
performance state according to a thermal indicator. The description of the invention 
set forth herein is illustrative, and is not intended to limit the scope of the invention as 
set forth in the following claims. For instance, while this invention has been described 
with relation to computer systems such as desktops and a class of mobile computers 
referred to herein as notebooks (which may also be referred to as laptops or portable 
computers), the teachings herein may also be utilized in other computing devices, 
such as servers, multi-processor systems, work stations and/or portable computing 
devices such as personal digital assistants, (PDAs), which are handheld devices that 
typically combine computing, telephone/fax, and networking features or in other 
computing and/or communication equipment, where such power management 
techniques described herein may prove useful. Other variations and modifications of 
the embodiments disclosed herein, may be made based on the description set forth 
herein, without departing from the scope and spirit of the invention as set forth in the 
following claims. 
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